Projection image-to-image translation in hybrid X-ray/MR imaging

The potential benefit of hybrid X-ray and MR imaging in the interventional environment is large due to the combination of fast imaging with high contrast variety. However, a vast amount of existing image enhancement methods requires the image information of both modalities to be present in the same domain. To unlock this potential, we present a solution to image-to-image translation from MR projections to corresponding X-ray projection images. The approach is based on a state-of-the-art image generator network that is modified to fit the specific application. Furthermore, we propose the inclusion of a gradient map in the loss function to allow the network to emphasize high-frequency details in image generation. Our approach is capable of creating X-ray projection images with natural appearance. Additionally, our extensions show clear improvement compared to the baseline method.Comment: In proceedings of SPIE Medical Imaging 201

Projection-to-Projection Translation for Hybrid X-ray and Magnetic Resonance Imaging

Hybrid X-ray and magnetic resonance (MR) imaging promises large potential in interventional medical imaging applications due to the broad variety of contrast of MRI combined with fast imaging of X-ray-based modalities. To fully utilize the potential of the vast amount of existing image enhancement techniques, the corresponding information from both modalities must be present in the same domain. For image-guided interventional procedures, X-ray fluoroscopy has proven to be the modality of choice. Synthesizing one modality from another in this case is an ill-posed problem due to ambiguous signal and overlapping structures in projective geometry. To take on these challenges, we present a learning-based solution to MR to X-ray projection-to-projection translation. We propose an image generator network that focuses on high representation capacity in higher resolution layers to allow for accurate synthesis of fine details in the projection images. Additionally, a weighting scheme in the loss computation that favors high-frequency structures is proposed to focus on the important details and contours in projection imaging. The proposed extensions prove valuable in generating X-ray projection images with natural appearance. Our approach achieves a deviation from the ground truth of only 6% and structural similarity measure of 0.913 ± 0.005. In particular the high frequency weighting assists in generating projection images with sharp appearance and reduces erroneously synthesized fine details

Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

Brain metastases occur frequently in patients with metastatic cancer. Early and accurate detection of brain metastases is very essential for treatment planning and prognosis in radiation therapy. To improve brain metastasis detection performance with deep learning, a custom detection loss called volume-level sensitivity-specificity (VSS) is proposed, which rates individual metastasis detection sensitivity and specificity in (sub-)volume levels. As sensitivity and precision are always a trade-off in a metastasis level, either a high sensitivity or a high precision can be achieved by adjusting the weights in the VSS loss without decline in dice score coefficient for segmented metastases. To reduce metastasis-like structures being detected as false positive metastases, a temporal prior volume is proposed as an additional input of DeepMedic. The modified network is called DeepMedic+ for distinction. Our proposed VSS loss improves the sensitivity of brain metastasis detection for DeepMedic, increasing the sensitivity from 85.3% to 97.5%. Alternatively, it improves the precision from 69.1% to 98.7%. Comparing DeepMedic+ with DeepMedic with the same VSS loss, 44.4% of the false positive metastases are reduced in the high sensitivity model and the precision reaches 99.6% for the high specificity model. The mean dice coefficient for all metastases is about 0.81. With the ensemble of the high sensitivity and high specificity models, on average only 1.5 false positive metastases per patient needs further check, while the majority of true positive metastases are confirmed. The ensemble learning is able to distinguish high confidence true positive metastases from metastases candidates that require special expert review or further follow-up, being particularly well-fit to the requirements of expert support in real clinical practice.Comment: Implementation is available to public at https://github.com/YixingHuang/DeepMedicPlu

3T vs. 7T fMRI: capturing early human memory consolidation after motor task utilizing the observed higher functional specificity of 7T

ObjectiveFunctional magnetic resonance imaging (fMRI) visualizes brain structures at increasingly higher resolution and better signal-to-noise ratio (SNR) as field strength increases. Yet, mapping the blood oxygen level dependent (BOLD) response to distinct neuronal processes continues to be challenging. Here, we investigated the characteristics of 7 T-fMRI compared to 3 T-fMRI in the human brain beyond the effect of increased SNR and verified the benefits of 7 T-fMRI in the detection of tiny, highly specific modulations of functional connectivity in the resting state following a motor task.Methods18 healthy volunteers underwent two resting state and a stimulus driven measurement using a finger tapping motor task at 3 and 7 T, respectively. The SNR for each field strength was adjusted by targeted voxel size variation to minimize the effect of SNR on the field strength specific outcome. Spatial and temporal characteristics of resting state ICA, network graphs, and motor task related activated areas were compared. Finally, a graph theoretical approach was used to detect resting state modulation subsequent to a simple motor task.ResultsSpatial extensions of resting state ICA and motor task related activated areas were consistent between field strengths, but temporal characteristics varied, indicating that 7 T achieved a higher functional specificity of the BOLD response than 3 T-fMRI. Following the motor task, only 7 T-fMRI enabled the detection of highly specific connectivity modulations representing an “offline replay” of previous motor activation. Modulated connections of the motor cortex were directly linked to brain regions associated with memory consolidation.ConclusionThese findings reveal how memory processing is initiated even after simple motor tasks, and that it begins earlier than previously shown. Thus, the superior capability of 7 T-fMRI to detect subtle functional dynamics promises to improve diagnostics and therapeutic assessment of neurological diseases

A new methodology for anisotropic mesh refinement based upon error gradients

We introduce a new strategy for controlling the use of anisotropic mesh refinement based upon the gradients of an a posteriori approximation of the error in a computed finite element solution. The efficiency of this strategy is demonstrated using a simple anisotropic mesh adaption algorithm and the quality of a number of potential a posteriori error estimates is considered